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ABSTRACT 



, i ^ 

A Study to .provide the National Center for 






Educational Communication (NCE)^ with information that could be. useful 
i^n. making the ERIC data base more- relevant, to tlj® needs of educators 
and more efficiently usable by them is discussed. Specific purposes 
•6f this project were to use- an empirical field-survey study as an 
a rmatjire , around which* to;- (1) Clarify* the Concept of . file (t % 
Partitioning in terms Of the mechanisms by^hich pa^titionrhg 

* achieves its effects; (2) Identify technd^l requirements arid 
prerequisites for effective partitiOniaigp of the ERIC.^data base; (3) • 

“Identify alterhate possible initial t^al ‘ERIC^file partitions /^hat 
' would appear to have some reasonable-*..^ikelihood of success; and (4) 
Recommend a general course Of action to follow in obtaining still 
more definitipve data'on Which to -base managerial decisions. The 
;:^roject involved three da):a- gathering activities. These were; .(1) a * 
review of current ERIC practices.,, (2) a review of some current : 

“^ERIC-related studies, and (3) a. quQ.stionnaiire survey. A compacison of 
'^the l’5 user-group profiles created by“ the cross- tabula tiojis revpaled 
some similarities t^ 3 t cut across all groups, as well as a:»number of 
'differences that set the groups apart. A tlj^ee-part inte^gi^ted 

* program is recommended that would provide tf or the developi^nt of .-the. 
required iraproveraents in the • descriptive system and for the .testing 

* of carididate partit-ions.' Program, parts are; (1) Develop and elaborate 
nonsribject descriptors for ERIC documents; (2) Develop associations 

' between descriptor and candidate partitions; and .(3) ’ Pferform 
selective’ dissemination, of ' inf ormatiori experiment. (Author/ck)^ 






O “ 

ERIC 

. ? .• 



< « 



* 



% 



\ - ‘i'. 



■ r 






% / 








FILMED FFOM BEST AVAILABLE COPY 



FINAL REPORT 



AliGU$T 1972. 

CYUTH^A C. HULI; 
JUDITH WANDER 



< . 



TM-4972 










\ ' 






N* 



t 0 

■ ^ 



li 



/. 






I 







t.' 

fei. ■■- 



. 

ERIC 



1 . 



* , 



i 

" N 



9 O 



4k - 



? - 



0 , ■ 

w 

V . 



• I 

y'' V. 



✓ •. 

•■' *' , 










FINAL REPORT 



AUGUST 1972 



N 



CYNTHIA C. HULL 
JUDITH WANGER 



A 



( • 



THC WORK RCPORTCD HCRCtH -WAS.PCRPORMCD PURSUANT TO A CONTRACT WITH THC U.S. 'OrPtCC 
or education, U.S, department or HEAR.TH, EDUCATION AND 'WCLPARE . OEC-0.7! »47l 8, 
WASHINGTON, D. Cm 20202. THE OPINIONS EXPRESSED HEREIN ARE * THOSE , OF THE AUTHOR AND. 
•SH0UL6 not be construed as REPRESENTTING the OP^NIOfN OR POLICY. OF ANY AGENCY OF THC 
UNITED states GOVERNMENT, . . .* 






TNiS d'qCUMCNT HAS HOT kcCH CLCARCO FOR OPEN PUBLICATION 



TM-4972 



t •> 



X 

■ ^ 







^ * < ' 



i 



t*' 



■ % 



V 



I . 

i 



V 



4 





9, 







i 






V 









X 



Sr 



ACKNOWLEDGEMENTS 



■ O 0 



I 



; The author's wish ^to express their, gratitude to all. those who contributed 

^ ^ O 4 ^ • 

. their time *and effort toward the preparation 'of this .report. Especially 

* • • * ■ ^ ^ • o 

important were the suggestions and technical input of Dy. Carlos A. Cuadra,- 
manager of SDC's Education and Library Systems Departmefit,^Dr . Robert V. Raster 

I* ■» '• ■'*^^ 1' 

and Miss Mary Jane Ruhl* William ’J. Paisldy'of Stanford University*' 

■ ' • ■ . ' • ' ' ' ■ \ ■ ’ 
contributed valuable comments and advice in his role as project consultant. ^ 

■ Dr. Herbert R. Seiden was . responsible* for- t.he overall, direction of the proji^ct. 

The study's Project Advisory Board provided critical review of the' survey 
instrument ^Tnd suggested j;^evisions for *‘its improvfement. • The membeis of the / 

. ^ . t . ' . . ‘ . ' ■ ■ > \ I 

board were:. Mrs. Barbara ^rodiOf Mi^s Elinor Defibaugh, Dr: Carter Good, 

Dr. Frederick Goodman,. Dr. Robert' Mclntyref Mrs. Martha R<iw^ahd, and . , ■ / 

m * i . ' . n \ 

Dr. John Starkweather. • ' - < > - 

We are -alsQ grateful fo^- the cooperation of the state and local agenci;^s who 
provided so much' help i<n the development, of a saiijple for our- questionnaire \* 

« surVey, ■ as well as, for the cooperation, o’f all the educators who participatecf 
in the surve'y. ' , . 



(' 



Cynthia C. Hull 
Judith Wangel^ 






■ 

. • 












O ‘ ^ 



\ 



O' ■ 



^Chapter 



TABLE OF ,CO{JTENTS 



■ y ' ■■ 



INTRODUCTION 



a: purpose of the. study' 



B. .THE CONCEPT OF PARTITIONING’, 
. o - 



Pa.ge" 

I-l 

i-i 

1-2 






. 1 1**. Presumed -Mechanlgm of Operation. . . . ;. . . 1-2 . 

2. Components of the Partitioning Concept . ... . .. -I-A.’ 

"3. Conditions Required, for Effective Operational 
3 ' ’ PaYtlplqnlng^ * ^ 



1-7. 



A. practical Limitations. to the Usefulness of Partitioning. ■ ' 1-8 

C. - SOHE PREREQUISITES FOR EFFECTIVE bPERATIONAL PARTITIONING ' . 

OF ERIC FILES . ..... ^ |i-9 



D. OVERVIEW OF FIELD SURVEY 



c 



'. , . 'I-^l 



. V Project Background .• . . . .< . . . . • • ... • . i ^ 

2-. |Dev.dlop.nient of User Profiles .. . .. . . . . ; • • • ./•T-13 



'[ 

igAn 



E”. , ORGANIZATION OF THIS REPORT.' .' . . 



II. EXECUTIVE SUMMARY. . . . . 

.Ai .INTRODUCTION ... . . 
' • ' B. PROJECT ACTIVITIES. . . 






mt • 

^ - 



. . . . . \ Ir.lA 

' ■ % 

. y . . .. ii-^i' 

V ■ ' 

. .... . ii-1 * 

. . . . . . ' II— 1 



1. -Revlew'of Current ERIC Clearinghouse Practices . . II-2 

'2. Review of Current ^RIC-Related Sliudles. ..... . . . . i II-3 

3. Conduct of Quest^lonnal re Survey . . ^. . . . .... II-A 

c. ■ USER— Group profiIiES . . ii— 5 

D. IMPLICATIONS OF THE STUDY’ FOR. PARTITIONING T.p 'ERIC FILE ... . II-7 

Ik- Potential Benefits of Partitioning the ERIC File .... 11^-7 
. 2. Alternatives for Partitioning the ERIC File . .'. ... . II-7 

3. Po-tentlal Bases foe, Partltioni'ng Jjie ERIC File . . ... II-8 

. ' ■ ■■ V ” * , ■ . ^ . ■ 

E. itecOMMENDATIpNS ... . . . S' . . ... i . .^. . . .• .'’II-IO 



1, Alternative Actions » 

2. . Recommended Program. 



II-IO 

11-13 



- . i 



11 ,- • 
V . . . 









TABLE OF.^eONTENTS (continued) . 

t- . . ' '■ 

» 

/ • • • . 






Chapter 

III.-: PROJECT ACTIVITIES ; , . . . v 

. ■ • . \ f *■ ’ 

• ' / ■ « * ‘ ^ < 

A. REVIEW OF CURRENT ERIC . CLEARINGHOUSE PRACTICES' . . . . . 

. ’ * 0 . ■ . ■ « 

■ B. REVIEW OF CURRENT ERIC-RELATED STUDIES* ' . . " . . 

»• ■ ' _ . _ . . 

^ IJ Evaluation Study of ERIC Products and Services i..'.': 

2. Evaluation Stud^ of NCEC Information Analysis Products r 
Final .Report . . . . . • . • • . . . 

' ' 3. Alternative Models for the EKIC Olearlnghouse'^Network. 



. ' . 

• ii;-i 
III-l ■ 

_ m-3 
iii^\ 



N 



III-7 

4. * A Summary of .Some K-ey Issues . . . . . . • • • • • III>-ir 



• • ♦ r 

C. CONDUCT OF„.QUESTIONNAIRE SURVEY. . 






■ - ,Vn 



1; Survey Design, . . ♦ . . . ^ . 

2. ^Questionnalr.e Mailings and» Returns , 

* 3. Data Analysis . ' . ; -i • • • 

■ t • 

IV. .USER-GROUP PROFILES. . . . 1 . . . . . .•. . 

A. PROFILES •. i . ‘. .. . . . . . ". .'. . . 



v.V 






\ 



. •. . III-14 

. . ILl-14 

III-19. 

. .' . . riI-19 

‘t 

%■ 

.. 0 IVttI 



. ^ 

B. “SUMMARY OF. PROFILES. .. . ; . . . . , IV-21 






C ' ERIC USE .... ........ 

D. RESPONDENTS' COMMENTS. .*. i. .• . . 



IV-22 
IV- 23' 



• V. IMPLICATIONS' OF THE STUDY FOR PARTITIONING THE ERIC FILE 

^ .A. POTENTIAL BENEFITS OF .PARTITIONING THE ERIC FILE . . 

. . ■ • ' * ' ■ ' , • - ' ; * . 

1. Awareness of. ERlU. . .... . .. . . . . ... . 



2. Retrieval Effectiveness. .... . . '. 

3, Acquisitions and Product Development 
■ 4... Targeted Dlssei^nat'lon 

' -I - ' 



B. . ALTERNATIVES FOR PARTITIONING THE ERIC FILE. . . . . . 



■rj 



1. Current Elements for 'Partltlonlhg\ . . . t 

2. Potential Elements for Partitioning 






• • • • 



I.'.' 



.,C. POTENTIAL BASES .FOR PARTITIONING THE ERIC FILE'. . ". . . ... 



V-1 

V-l‘ 

V-1 
V-2 
V-3 
* V-3 

\V-4 



y-4 

V-5 

V-6 



er|c 



; .5 



. < 



■ ^ ' 






■ : ■/ 



iii 



■. \ 



.TABLE .OF CONTENTS (Continued) 






Chapter 



VI. RECOMMENDATIONS 



% 

. . VI-1 



A. MAJPH. ACTION ALTERNATIVES . . . • «i . . . . . ‘VI-1, 

bT recommended PROGRAM . . . . . V. ... . . . . . VI-7 

1.' Develop and Elaborate Nphsubject Descriptors for ERIC , 

■ . Documents . ... . . . . . ^. . 1 . . . . .' . . . ^ , . . .* . Vl-7 



2. - Develop Associations- Be^een Des’criptqrs and. Candidate 

• ' Partitions ■ ' . . .* . I- ... .. .. . , . . .■ . .- . '. Vl-9 

3. Perform fS elect ive Disseminatl'on of Information . ^ 

- .Experiment . I'. . . ... . ....".J . . . .77 . . VI-12^ 

4. Integrated ^Schedule for Rec'Simnended Activities • • • • VI-14 




LIST OF FIGURES AND TABLES 



Figure 

f' 

V-1. ‘ 



Tables 

lil-1 

II I- 2 

iv^i 
IV- 2 
IV-3 ' 



IV-4 

• O 



Represent at 
User Groups 



Q 



of Primary Need-Patteriis. of .Various 



V-12 



Typology of User Groups Showing Relation of Samples, 
to ■ Re t ur^^ • • • • • • • • • . % ' • ^ » • • • • 






Highest Levels of Education Attained; by • Elementary, and 
^Secondary Teache'is '. . . . . . . 



« « « ■ 



User-Group Profile — Pfes(^ool/Kindergarteri oTeachers. 






User-Group Profile — Elementary Teachers 



User-^Group Profile — Secondary Teachers . 

•User.-.Grriup Profile — 'Adult B^sic Education Teachers . . . 



IV-5 

lV-6 

IV-7 

IV-2 

IV-9, 

^ ■ 

"iv-ib 

IV-ll 

IV- 12 

• « 

IV- 13 



Ijser- 



V- 



Group ‘Prof iley-Postsecohdary Teachers •. . . 



User-6roup Profile--, Reading Specialists. 



Usfer-Group^Profile— VocatibnSl Educators • ' - 



User-Group^ Profile — -Special Educators . . 

.•■w ' ' ’ j , • • 

User*«Group Profile--'Superin-tendents^.chool -Board- Members' 
’^er-Group Profile — ^Principals/Assistant Principals. • 



is® 



User-Group Profile — Counselors/Psychologists 

User-Group Profile — Librarians . .... 

User-Group Profile — Consultants /Superyisors/curriculum 
Directors^ . . . : . « ... . \ . . . . • 



IV-14 User-Group Pjrofile-- State Agency Staff -. . . . . . . 

IV- 15' User-Group Profile — Researchers. ^ . . o . . 

' ' . * ' * ■ 

V— 1 Candidate Fartitiono . ... . . . . . . . . . . . . . 



‘ Illr23 



. III-24 
'. IV-6 
. iV-7- : 

. IV-8* 

-. IV-9 
\. IV-10 

ty-11 

. V IV- 12 

, \‘ ' 

TV-13 

■T"^lV-14 

. I ■; 

. iv-15' 

\ 

. IV-16 

. IV-17 



. ' IV-18 ■ 

. iy-19 

. IV-r-20" 

. .V-15 



/ 



. 

— ✓ 



I . INTRODUCTION 



A. PURPOSE OF THE STUDY 



• . . , O . • . • - 

T'he general .,goal of this study was to provide the National 'Center for Educa- 

tiona2. Communicatloi} (NCEC) with information that, could be useful in maRtog 

■ ' ‘ ^ ' ’ ' ' ■ / ■ ■ ■ • • " y'- 

.the’ ERIC .data 'base more relevant to the needs of educators and*, more efficiently 

usable by then. /The. specific' purposes of this ^project were to use an empirical 

- ■ ■ ’ ■ '■ ■ ■ ' t-f ' \ ' 

field 7 Surv'ey study as an armature aroupd which to; ' ■ * ■ <». ‘ • \ 



•s 



• clarify the^ concept of file partitioning in terms of the infechanisroa ' 

. ■'by wh^h parti’tioning achieves j^s effects^ the conditions required - ' 
for effective partitioning, and the practical limitations to the use- 
fulness, of partitioning.- A • ' 

• identify' technical requirements and prerequisi^tps for effective ^ 
partitioning of the ERIC data base, in particular, address ing/jim- 

. ~ ■ c ■ * . ■ 

portant questions. of feasibility that need to be solved if parti- 

tloning were to becomfec a re'ality as a general operational procedure. 

O . ■ .X ■ • ’ 

* ' * • . ■ V ' 

• identify, through empirical means, alterriatiye “possible initial trial* 
ERIC file partitions that would appea^ tp 7 .haye_-somer reasbrtabr^ like- 

_ -• llhood of s'ucce^. \ ^ ’ 

. ^ ■ j ■ * • ■ . 

■ • recommend a general^ course of action to follow in obtaining still 

■ ^ more definifi\fib data on which tb base managerial decisions. » 1 



The first two objectives ate* addressed in this Introduction; the others dre 
addressed in Sect.ions and VI. . . * 

. - ‘ V. ' " • • 
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Presumed Mechanism olf Operatisiii ■ 

« * , ; ♦ 

^ ^ V f , 

The presumed mechanism by which partitioning of files achieves desirable 

effects Is that of minimizing the 'expected ratio between the proportion of 

* ^ ; - • ' . * 

% . • * ^ 

Items of irrelevant- or noisy Informatlbn.dellvered to a "typical user" aa 
compared to the average degree of relevance, pertinence, or usefulness of 
the Items he receives. This definition holds whether the desirable effects 
of partitioning are being sought for purposes of Improvlngjthe accuracy of 
retrospective or demand searching; improving the imp.act and usefulness of 
SDI services; or for easing the administrative and dperatlonal problems’ of 
file maintenance, updating, and expansion. In each c;ase, to ^:^chleve a given 









■ .'.|oal pf inf ormedness - f or a typical randomly selected occasion of use, the 
j amount -of Information that must be scanned (either by a machine or by the * 
himan user)' Is kept- "to a practical mlnim\an. (Below this practical mlnlmufn, 
the maintenance costs of further refining the output exceed the accumulated 
benefits to the users.) 

This 'definition e^iploys the phrases "expected ratio" and ."typical user" to 

^ • ’ - — , " r"’ . 

emphasize the Idea that the a^antages- (under- some conditions) to be gained 

- f rom“pS^ftitibnlng of files are dependent solely on the correctness of pre^ous 



] analyses of the situation; in fact are dependent on the accuracy of predl^lons 
of the. expected ":behavlor and requirements of the average or typical user who 
Is a composite representative of ‘a homogeneous user group. CWhile the, same 
can be said of all forms of axtlfPcts In support of information, services, 

, - ' ^ ^ • J 

the -goals •'^d assumptions of file partitioning make this dependency somewhat 
more transparent and more crucial.) While -the notion of "proportion of Items, 
of Irrelevant pr'nolsjT'lnformatlon'.' Is directly eqviivalent to the well-known 
concept of search precision (after Cleverdon) , the Idea, of "average degree of 
relevance, pertinence, or usefulness of the Items he r^^celves" Is not directly 
equivalent to Cleverdon' s concept of recall value, though It Is similar. . 
Cleverdon's recall- value. Is defined asjthe proportion pf the Items existing 
,, in the 4ile exhibiting a certain degree of-^elevdnce pv greater , that were 






delivered by the eedr'ch. This definition emphasizes the atcuracy of > the sehrching 
mechanism in providing an ^ exhaustive response in relation to the material 
availably in the file, On the other hand, the preselilf definition doe^ not em- 
phasize exhaustiveness ,y but rather selectivity of file, contents .(and output ^ 

■ y ' . * * . ^ ^ 

delivery) inAirelation to au expected pattern of need for information. 



.p 






The concept 'of. file partitioning i's, therefore, not', conf in*^d to impijbving the 
-transmiasipn capabilities of the information system by improving the. information 
description language, and search mechanic's . . Rather, ''it aims to supplement ^ 
these techniques''through the more active mechanism of (effectividly) filtering 
the in^ut 6o file partitions' to achieve a high ratio of predefined information 
utility as compared to the amount of .scanning activity required by the system, 
the user, or both in obtaining the information. * . . 

' S ■■ ' ■' ' ' ■ 

In relation to retrospective demand sear-ching , this,laff iciency is gained, 
partly, ty reducing the niimber of iterations.of the query fonnulation required 
pf__the_user to gain the desired output and, partly, by sharply reducing .^the 
size of the file that the system* must scan in order to respond to each of the 
user's requests. Both sources of savings of .scanning effort can be very sig- 
nificant in reducing costs. . i - ' ’ 



In relation to the perceived/^ility of published products ,. file partitioning 
may prove tb' be an aid in several ways. First, it can improye the scan-yield 
ratio for,rea:aers by re4ucing the' proportion of irrelevant items seen while at. . 
the same, time indreasing the average >rele?vance of the regaining items delivered. 
Second. I'lt mav operate to provide a cohesive need-group' identification con- 
ceptualization around wliich can be organized activities of refining that concept, 
of 'improving . the service in relation to itj of obtaining concerted feddback in y 

relation to it, dnd af mounting effective promotional campaigns .in relation to it. 

* \ ■ 

-■ ' • ^ ' H 

In all these cases of possible benefits, .fhe actual ef fectivenegs-Achieved 
will -depend on the ..iegree to which the file partitioning patterns ‘actu^ly 



• 



■ 



- 



& 
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V 



reflect the patterns of user need as' tKey are translatable into patterns of ^ 

selection 'from amongst available information. ' ^ . 

• ^ ^ < . ■■ ■ > ■ ‘ ' • 

■ * ’ / . ' . . ■ 

In relation to' the. value' of file partitioning . for the actiYities of file 
main^nanpe and file mavagement, there ^ are two main sources of possible gain. 
First,. the requirements for currency and thd useful life span of information 
both vary. for different kinds of i^ser groups. ' Therefore, .file updating and , 

■V . • . > * ' ‘ 

purging operations, to remain efficient, must vary for different- kinds of 
information and can often be more easily managed if the .same rules apply to 
all informati(^n within a given .partition, while different 'rules apply to 6ther 
partitions. Second, it is likely that the task of identifying gaps in the 

* ' 7 'if * • ' 

^available literature; or in the file holdings^ould be made easier for system 

» ^ 1 » . . . ^ 

personnel and for users if infomation were organized’ into user-responsive 
file partitions;' ' . 

- ■ O-"' 












V- 



2. Components of the Partitioning Concept" 



w-Kithout regard to situatior^specific feasibility ^and cost-/ effectiveness 
considerations, thr^e^general components must exist J|or a given file 
partition ^^Jiavethe potential of being useful. These ar,e, a stable and 
convej^gerTt users ' need patt'axn, a stable and discriminating set of iny 
-^formation identifiers and descriptors, and a certain, defined minimum of ^ 

- overlap .with all other users who are defined as being outside the group 
showing that need pattern. 

' ■ ' ' * ’■ V 

A ^ i 

While the concept of a stable and convergent users ' need pattern may^seem , - 
obvious, it has subtleties^ that deserve some discussion. Sta^lity' is a . 
relative matter, cf course, but for-' a file partitioning pattern to be effective., 
it must accord well, . and be kept ^current, with the users' actual need ^atfem. * 

If the users ' need pattern changes too rapidly, the cost of maintaining ' 

■ / « ‘" * * * • 

an accurate picture of it jnay well exceed the value of the file* Thus, 

it is important to try to evaluate the expected rate of change- for a particular 
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group pf users and to take the cost of maintaining an accurate picture of the 
current patterns of needs into account, In considering whether file partitioning, 
would be a useful strategy to improve the cost/effectiveness of the services 

I 

provided to that user group. < . 

'In addition to b^ing .stable enough, the users' need pattern must be convergent 
enough. Another way of saying thlp is that a users’ need, pattern must be homo- 
,, geneous enough so that any single "need- envelope" description depicts the needs’ 

■ of a sufficiently large group of users, so that the cost of the procedures 
. to partition the file will be balanced. by. the value of the benefits weighted by 
. the number of^users receiving' them. A users' group might well be made highly 
convergent by excluding "deviant" cases it j but the result could be a 

groitfp too small to justify the'^^ts-pf^^qfwblishi^ a special partltiiSn ^ 
for them.' Thus, there is yet ^nother practical-ddj^t to the extent to which ' 
files can be usefully partitioned arid subpartitioned is a technical 
cha.Vlenge to formulate criteria, for appropriately estimating that limit. ' 

■ '■ ■■ ■ "■ ’■ ’ ■ . ^ 

■' The req* Iremei^ts for a stable and discriminating set of Information Identi^^s 

and descriptors are also apparent . As for descriptor' stability, If the 
meanings attributed to descriptors by users are at great variance with thos'e 
attributed by indexing personnel, for example, or If the pattern of use of 

O ^ '* — 

a descriptor or identifier changes significantly over a short period of time, 
the matching mechanics of. the system will be distorted by that ai^c^ntT Such 
mismatching will be reflected' in less accurate patterns for file partitioning. 

* The problem of identifying discriminating descriptors and Identifiers’ is a . 
general one. a distinction that clearly discriminates between the need 
patterns of two significantly different user groups has no well-understood 
representat ion: in th!l vocabulary or indexing procedures used to characterize 
^.'the information, that distinction cannot be used as e basis . for'^ partitioning 
the file. While this seems obvious, it is not always clear, fot example, that 
' in’ practice., doctmierit form designations used to discriminate citems presumed to 
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be of interest more to eJ^her applications-oriented or to research-oriented 
ERIC user groups do correlate well with the actual contents of the items. 
Thus another very important task is to ensure that, as potentially^ useful 
user-group file partitions are defined,, apptopriate and truly d'^jScriminating'^ 
Judgmental criteria and associated identifier, tags are devised and refined 
^ and added ^to the indexing procedures-. ' < ' . . 



^ *1 
" • A 'user group might exhibit stability and -convergence of needs and there also 

0 . s ^ * 

jmight be a stable arid dfscriminating set of informaCion' identifiers and des- 
. cripto^, and still the group might not be. useful as a basis for, file partitioning 

because it fails to meet the thijrd minimtiin criterion, which is td possess' a , 
certain defined minimum of. over lap 'with all other users outside' the-. group 
This is another way of j describing the technical problem of establishing cutoff 
•criteria and cutoff points for defining the outside limits of the des- 
criptive envelope that characterizes a group's need an'd use patterns. This 
'problem is complicated by the fact that user group boundaries are not- always 
. symmetrical arid mutually exclusive; one interest group can be completely or 
partially a ^ubset of another more inclusive interest group, the members of 
the more inclusive group being interested in' all or a large portion of the 
material of I the included group, but the members of the included group being 
interested inly in their own material and not in that of the more inclusive 
group. Something like this may appear in certain areas of the researcher- 
practitioner\distinctioii, where, the researcher sometimes has a more inclusive 
interest patt,ern; or, again, in' the patterna of interest exhibited toward 
eductional methods and matei^ials aimed at remedial versus standard educational 
practice. It would appear that the minimum requirement for lack, of overlap 
necessary to make a corresponding file partition of practical use would be 
a' condition of asymmetry in which a smaller "included" interest group shows- 
a clear arid. well-defined lack of interest in material that is of interest, 
to J:he larger "inclusive" group ^o have a broader interest pattern co-yetlng 
the material of the smaller ’’’included" group. In this case, the justification. 
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for establishing a file partition for the smaller grot^p would be the. usual 
one of efficiency described earlier. The -fact that another broadet^terest* ' 
group was also' interested . in this /area of material would enter, consideration 
^ in only, two ways. -First would be a methodological 'consideration-: to ensrre 

that the broader , interest pattern '’data was not gathered and analyzed^ In such 
way as. to obscure the' requirements of the narrower Interest,, group. The' 
second would be .an operatlonalrconsideratlon: to establish easy and suitable 

means by which the broader interest group would have access to the. narrower ' 
group file partition. The asymmetrical pattern just described, may turn out 
to be more common than the symmetrical case Ity' which • two or more groups 
‘ actually,:^exhiblt-mutually ejccluslve interest, patterns. This complicates both 
the file partitioning' strategles‘'ahd the operational procedures necessary to 
reap t^e potential advantages from file partitioning. ‘ . . 



■ 3. Conditions Required for Effective Operational Partitioning 

f n ’ ’ ’ ^ » 

Some of ^the conditions necessary for ef^^fctlve partltlonljig'-have already been 

‘ discussed In the previous section. These Include high-grade vocabulary sup- 

port and maintenance and. high-grade -indexing .practice which Incorporates the 

. • • - 

item tags and Identifiers necessary.c to allbw materials to be sorted Into the 

. • ‘ . f 

, O ‘ . j *i ■ _ . * 

dlfferentMile partitions. Two other '■conditions that appear pecessary for 
operational success are the “exlstenpe pf aii.^f f Iclent continuous sensing : 
mechanism to allow for sensitive, accurate system response to requirements 
imposed by the Changing and eaq)anslon of' Information activities and, second, ■ 
-the existence bf an explicit plan for system development and for the opera- 
ting' system configuration, so that responsibilities and areas bf purview can 

* • ■ ■ t ' ... 

be allocated, so that areas of conflicting interesrt: c*an be Identified,' and so 

that mutual' understandings are properly documented. The point Is that<ille 

, partitioning as an operational strategy will not simplify operations or ^ke 
. . ■ ■ H ■ ■* . ‘ 

them less. costly; it will, ratber, complicate them and make them more costly. 

Provided file partltionlpg turns out to be warranted, this additional cost 

is the price paid for achieving for the user a technically superior service. 

' ■ . ' b ■ ' . 
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The added- structure in the system represerited by file partitioning programs 
increases the systbi’s vulnerability to change, if only In the sense that 
change not sensed and adapted to might- reduce the Quality of service to that 
represented by the earlier operation, while still incurring-^:he extra costs 
attendant ^on file partitioning. This added vulnerability must be compensated 
by a corresporidingly higher level. of • effort in. adapting the system to change 

' • ’ ^ ‘ . 'ft ^ 

and in managing the more complex configuration. 

■ .1 .. • ' 

4. Practical Limitations to the Usefulness of Partitioning 

Two kinds of limitations have already ‘been discussed: (1) areas of material 

Inhere the rate of, change in characterization and use of information is too 
great; and (2)’ the cost-effectivmess limits that will inevitably be reached 
if the file is partitioned’ and subpartitToned into ever-f IneF-categories re- 
presenting smaller and smaller user-interest groupings. There- are at least 
two other kinds of practical limitations that deserve mention. One has som- 
wh^t the quality of a mild paradox: while it is the areas of high interest and 

usage that would appear .to generate the necessary justification for the extra 
expense of file partitioning, it may well bV that some areas of low interest 

. -5 ■ ' ' . 

and vsage would benefit most froin the tmprpved service.^ This represents 
another factor' that mitigates against a simple cost-reduction or 'efficiency 
justification for -introducing file' partitioning, and further_^einforces the 
idea that better service will inevitably cost more. . ... 



^ o . 

Another practical limitation has to do with users* insensitivity to system- 
- incurred costs as compared to costs incurred by themselves. . As one example, - 
in a dial-up on-line retrievaij. service, users will be very sensitive to speed 
of ‘response if the^ themselve^ have to pay charges for telephone connect' time 
^r computer time, and will .be much less concerned about -system-response latency, 
if all costs are absorbed by public funds . A user- who has to partially or 
completely pay for the services rendered him will Jje much more appreclative- 
of the efficiencies created by proper file partitioning.' 






. ^ 

ERIC 



: 15 

V- i, *• ■ • 

• 



1-9 



In. view of the evidence to be cited later of the considerable dmand-searc! 
use made of some ERIC products not designed for that purpose^ and in view of»° ‘ 

■ high cost of demand search services j the importance of file partitioning for 
ERIC demand-search services that are partially "us^-paid should be evident. 
Further, each proposed application of file partitioning needs to be considered 
•in terms of whether its effect, can be sensed easllyby users to justify the 
extra. costs involved. ^ •", 



- C. . SOME PREREQUISITES FOR EFFECTIVE OPERATIONAL PAg.TITIONING OF ERIC FILES 

• . _ - ■ . 

If the continuing) investigation of the ERIC Users ’ information use and’ need 

patterns' indicates, that file partitioning should be useful arid practical, at 
least thr,ee pialn areas of planning re^itements and technical concern will 
-heed careful consideration. . These are;/ (1,) ERIC vocabulary control, thesaurus 
, development, and indexing practices refinement; 0-) ERIC operational centers 
organizational structure and work, and budget allocatioiis”; and (3) ERIC_system * 
■'services expansion plan ^ References, are scattered' through the text pf this 

report to '.each of these “areas of concern wherever appropriate to the technical 

' . . .. 1 ■ . 

discussion. The brief treatments here of' each are Intended to cover some 
, \ . > ' ... 

■points that find no opportunity for discussion elsewhere hnd, also, ito provide 

a rounded sketch of each body of considerations as seen in the flight of a :pr&- 

requlslte. • ' ' • 

Vocabulary control* thesS^tus development, and< indexing refinement practices 
are activities tha't share t^.e common ground of concern for the accuracy and • 
mutuality of information description. Two underlying factors govern much of 

• *j 

the planning and .direction of these activities: cpntrol of "nyming" relations,' 

between teirms (synonyms,' hypernyms ,• hyponymsj antonyms., and associative terms) 
and control of contexf-sensitive^ambiguity in 'interpreting, terms ' and phrases. 
Both the "nyming" relations of -a term (or phras^ and' the' sense-usage inter- 
pretation of it are often context sensitive, in that these, factors vary depend- 

' ' ^ ‘ '-I • ^ . 

ing -on the text in‘ which the term or phrase is embedded. This is particularly • 

‘ . ■' ■■ T'. ' . ' ■ • 
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• ' , . . 

true of detailed interpretations and Specific nyining relations of medium-level 

terms in generic-specific hierarchies, which are the terms often carrying most 

of the' communication load .in uncontrolled" indexing operations. The complexity 

of both these factors increases as a function of range ^f diversity of topical 

content in the corpus of discourse (information) from which t;he term or phrase i 

.1 

is extracted or to which the term or phrase is applied as a descriptor . The 
obverse implication is that file ^partitioning can have salutary effects on’ 
these two factors. 'Two such effec^:s are identifiable: first , ,'proper f lie ; 

partitioning will reducejth®?noise 'of both nynrLng and context-sensitive ambi- 
guity for terms as used in reference to each file partition, provided that.:- 
their use in indexing, data description, and query formulation is explicitly ' - 
with reference to tMt file partition, fiecond, in order to realize these- 
potential gains for many- terms and phrases, different n)miing relations and 
sense-lisage definitions will need to be depicted for use ^th different file 
partitiorife. From a pr^ictical standpoint, the. nyming relations of terms in a 
thesaurus are usually hsed to' Wproye the ease of entry to a. controlled voca- 
bulary subset, by developing .pointer relat'iq|is from^easily recalled but impre- 
cise or ambiguous terms ^to bar d-to-rec all but easily recognized terms 'and 
phrases that hav§, or can be assigned, precise interpretations. These pointer 
relations are likely to’ vary somewhat from file partition, to file partition. 

■ ■ 1 ^ ^ ' • t 

r And while they will yield , real 'gains in communication accuracy an^ reliability 
if properly handled, they do require extra effort in the vocabul^ary control 
and Indexing operations. . ^ . • - 



It is clear that* ,a pattern of file partitioning in ERIC is presently in effgict. 
and that this pattern jj^s- correlated with the organizational structure and’ 
.assigned responsibilities of-, the ERIC centers . it is also clear that if a 
radically different file partitioning were to be adopted, a different organi- 
zational structure might be needed, and that problems "of efficient realloca- 
tion of effort and ^problems of organizational change could ]pe created, but these 
are beyond the scop^ of competence in the present report. 






What 1b worth' mentioning in this regard Is that data from past, present, and 
possibly future studies that are atoed at the problem of new partitions for 
the files are drawn from users' whose expectations .and usage patterns have been • 
conditioned by the present partitioning structure 'of the files. There Is no ' 
objective way to assess the degree to which users' reports may be distorted 
by pro or con reactions fo the present file structure. What can be stated Is 
that useir evaluations and' reactions should not constitute an unquestioned 
100% of the, evidence by which file structuring plan^ are formulated, and that 
an obje.ctlve;yardstlck_ or method that frees evaluations from- deipendency on . 
the. present' file Structure would be very desirable. If such could be discovered 
However, to the extent timt present usefs-.^habltually contact more' than« one file 
(or center) ^or .the bulk of their Inf ormatloh needs , there Isvreason to. ques- 
tion the efficiency of the^presenb- design. ' - 

. ■ . ’ • ' , • ' • < 
s ' ■ ■ . 

Evidence cited elsewhere In this report suggetfets that expansion and prolifera- 
tion of the range of services offered by. ERIC is all- but inevitable.. 'Three 
examples are the lltely development of PIE. (Practices In Education) reports 
as a complement to RIE ' reports', an Increased' emphasis on the alerting function 
of SDI activities, and . the advent of widespread dial-up, on-line demand ser- 
vlces’-for ERIC users. Each of these .has some Implications for possible file 
partitions' that do not no>r exist' and for which the need might not be directly 
Inferrable from the evaluative; responses of Users. -The conclusion we draw 
from this >ls that some file partitions and services may need to be tried out 
without "hard data^ justifications for the trial and supported more by ana- 
logy, imagination, and an act of faith during the test trial period. 

■ ■ ' . ' ' .' ■ 

D. OVERVIEW OF FIELD SURVEY 

The major pr'oject activity was the conduct ^of a questionnaire survey from 
which, user group profiles could be developed and examined fo^ the feasibility 
of translating them into user-related 'partitions. As background for considera- 
tions In 'file partitioning, the project staff also reviewed current ERIC prac- 
tices and some of the current ERIC-rclated -studies. 
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As initially, conceived , the project also involved an analysis of ..the cur fen t 
ERIC file, \^ch is indexed and, therefore, accessed-'by'subject^escriptors . 
(3aj|[^dldate ^partitions x^ere to be made^pleiy 'along subjectNdlraenslons Identi— 
fied through a cluster ^nalysi's'^ currently used ides crip tori? and matched 
against the survey r^ults of educators ' information requirements . At the 
request of NCEC, the design was broadened, and. placed into a prospective frame 
work so that <non-subject descriptors (e.g., document-bype tags) could b^ 
explored for their potential in the identification ^f future file" partitions 



that reflect the different heeds of .educators groups. 



1 . Project Background . 






The first task In the initial project design was" to develop subject-area 
dimensions of the ERIC file. These dimensions were to reflect file content 
..in terms of subjects — represented by the Thesaurus descrlptors--that are 
"regularly linked together , In practice by system inde^cers. ^The basis for 
determining- linkages between subject areas were frequencies of descripto'b 
use 'and consi-stent strong relations bet^ween terms. The 750 terms fhat were 
used most often by indexers' to describe ?documents in tha current file were 
subjected to a, statistics:! analysis which displayed frequently co-occurring 
terms.* * These»co-occurrences were to become the empirical bases fo‘f the 
conceptual dimensions. . \ 



\ 






The questionnaire was , at that time, organized around the subject dimensions 
generated in this task. The educator would have Indicated his interests from 
a. list of approximately 100 dimensions and have answered questions related to 
these interests. An analysis of the relation between tbe subject dimensions 
and various^^groups of educators would have become the basis for partitioning 
the ERIC file. • ■ . • • ** 

... 'V., 



*Although this . task was not completed due to the change in dltecjtlon of the 

• study, a description of this preliminary analysis and some discussion of the 

results are ihcludAd. as Appendix A of this report; . < 
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With guidance from NCEC, the emphasis on subject areas was shifted' to a broader 

' c $ • ' ^ 

concern for .developing- partitions along non-subject-related dimensions that 
•might reflect the profiles of different user groups. The approach, then became 
l^ss retrospective* ‘Documents in the current file are represented primarily 
by subject descriptors since current indexing does not «cover non-object docu- 
ment characteristics such as document, types . Further, this. prospective attir 
tude was in keeping with NCEC’s desire to identify needs for new products and 
flle«areas that%required greater coverage. * ^ 

f .■ ’ ■ 

2 . Development of User Group Profiles ‘ • 



Design of the Questionnaire . •' . . , 

\ • * 

'Although time and tost restraints precluded the complete redesign of the ques- 
tiormaire, a. major effort was' undertaken to adapt it for" purposes of exploring 
several profile elements, Including the following Information-need areas : 



•. Broad subject areas 

• «Uses 01^- applications. 

,-*'> ** 

• -Document types 
*/\ Frequency of need 

• Intensity of need 






Questions were also Included that concerned respondents' role and function, 
personal background information, and current Information use patterns with 
’respect to ' principal sources currently used and use. of ERIC, A final ques- 
tion was ppsed in a free response to' solicit recpimpendations for. new products. 

■ '■ ~ c 

0 . • . . ' 

A major feature of the questionnaire was the linkage of the responses to each 

. question with different subject areas or uses considered of primary importance 

a ■ . . ' • • 

to the respondent. , In this' way, it was hoped that distinguishing patterns of 

needs— in terms of -subjects or uses--ciouldi if t^ey existed, be revealed for 

... • \ 

'* purposes of identifying different partitions f<^ a given user group. . 
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Condlict of Survey — ’ . . ^ ^ 

In an attempt to reach a proportionate sample of 3145 educators, representing. 

28 categories of educator groups, .6919 were surveyed. The primary sampling < , 

- • • *f . 

units in this nationwide survey were 20 school districts in 18 states.' To' 
cover the broad spectrum of educators, 5ther sampling, units were added, in- \ 

' ' ”, ' ’ I 

eluding private nursery or preschool institutions," junior colleges', adult 
educatoijs, private vocational and technical institutions, institutional and 
university researchers and state agency personnel. . 



Although questionnaires were mailed to 6919 educators (representing a 2.2 



oversample) a total of 2258 questionnaires, '^r 33% were .returned and analyzed. 



Data Analysis . . 

'J The data from the survey questionnaires’ were tabulated to' create profiles for 
’.-15 user groups. -These profiles showed the patterns of Information need for 
the various' groups and prpvided a basis for considerations of study implica- 
Stions and recommendations. . * 

w ^ ^ ^ ■ I • 

- • . ' . , 

E. ORGANIZATION of’ THIS REPORT . - 

The highlights of the report are given in summary form in the Executive Summary 
' • which follows. Chapter III’, Project Aetjivities, outlines, the methodology of”^- 
the. study. Chapter IV, User-Group Profiles, contains the information-needs - 
profiles of fifteen user groups, as drawn j^rom the -survey data. Chapter V ; - 
disc'iisses the implications of the study, and the final chapter presents 
'•the recomriiendations deri'v^ed from the study.- Supportive' data and materials 
are contained in four appendices. 
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II. EXECUTIVE SUMMARY 






< A. , INTRODUCTION ' • •. • . ' . 

The general goal of "this study was to assist the National Center for Educational 
Cbiranunication* (NCEC) in formi^lating. plans for making the ERIC data base more 
relevant to, and usable by, the broad spectrtnn of educatojrs. #The specific focus 
of ■■ the study was on the concept of file .partitioning and on the promise and 
problems associated with applying »the' partitioning' concept to the ERIC* file. 

. ■ ' -f-- ■ ■ . ■ ■ : :,f • : . ^ 

The. objective of partitioning is to help minimize the proportion of irrelevant 
information delivered to the user and maximize the average degree of relevance, 
^of the' items that he does receive. Achieving tbis goal is dependent on ^e 
degree of accuracy with which we can predict the information needs of the typical 
■ user for whom the file partition is intended. File partitioning improves the 
transmission capabilities of the system by actively filtering^he input to file 
• partitions so as to help, achieve a high, degree ofv, predefined information utility, 
with a minimum. of ‘post-search scanning activity by the user. 



& 



To be potentially useful, a file partition must be based on Stable and convergent 

patterns of users’ r\eeds, must be described by a §fable,and discrimina^ng set 

of. information identifiers and descriptors, and must involve" p defined minimiM'/'"^ 

of "overlap with all other user groups. To be effective, file partitioning 
’ * ' * . - * ' ^ . 
requires high-grade vocabulary support and maintenance and high-grade indexing" 

practice and operational control. . ^ * 

- ■ . " ■ 

.yile partitioning will, in all likelihood, make operations more complex and. 
costly but, -if done on a sound technical basis, it can provide the users with 
a technically- superior service. - * 



\ 






B. '"project ACT]Ji^ITIES '' • . ' ' 

• * \ • . • 

The project 'inyolved three dat^rgathetihg activities. These were; 
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,• A review of current ERIC practices; 

• A' review of some current ERIC-relateH studies, and 

• A qjiestionnalre survey. 






1. Review of Current ERIC Clearinghouse Practices 
5 ^ ^ ^ — 

The review of' current ERIC practices focussed on an examinatiofi of clearingjiouse 
efforts in pavtfitioning and document tagging and the concerns in these ai^^as 
that were expressed by clearinghouse personnel.. Interviews with personnel from 
each of the several clearinghouses yielded the following findings: 

■s' . . • ■ 

; • Many clearinghouses- divide their coverage into a small number 

..of broad subject areas. 

V 

-I ■ . - ’ ■ - ■ ■ . 

• . ^ny clearinghouses, use nonsubject tags,- but the. methods for. 

applying these tags differ. " * =... . 

■ • Clearinghouses using document- type descriptors use them only 

when an individual ^indexer feels the;^ are necessary or appro- ' 

priate, . . . . 

• TV^r.e'is no agreement among clearinghouses on the value />bf ’ 

. document-type descriptors. ’ 

a . I j 

• There is also lack of agreement' on the value of a time-rbased 

division of the file. ' 



} 
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• Some clearinghouses tag documents by educational level. 

• Current nonsubject descriptors are not always used and, in 

» r. ■ ■ !j . 

some cases,- . they are not usa^ with any degree of regularity. 
This inconsistency is caused, in part, by. 'the lack of standard 
guidelines fbr using these kinds of descriptors. “ « 
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• There is general 'agreement that some' method of subsetting the file* 
would mgke retrieval and, consequently, dissemination more manageable. 



2. Review of Current ERIC-Related Studies 






Three recently completed studies of the ERIC system were reviewed by. the project 
staff for their possible contributions in .considering the need for, and benefits 
of, partitioning. The data collections in each study were also 'examined for 
their usefulness in defining the actual partitions. The three studies are: 

• Evaluation ^udy of ERIC Products and Services . Bernard -M. Fry.; 

'■ 'Graduate Library School, Indiana University, Bloomington, Indiana. 
March. 1972. ' ‘i? . .. * . 

• Evaluation Study of NCEC Information Analysis Products; Final Report . “ 
Judith Wanger. System Development Corporation, Santa Monica, 

California. June 1972. ^ 

, « ' * . ■ 

• Alternative Models for, the ERIC Clearinghouse Network . ' P. W. Greenwood 
and^D- M. , Weller. The RAND Corporation, Santa Monica, ..Calif Qriiia. 

‘ ‘^January 1872 ' . * ' 

T, ' ' ' ' <r ^ , . ' . ■ 

The purpose of the Fry atudy was to examine the use made of ERIC products and 

/ . 

services by members of the .educational community and, in this context, to 
. ■ ^ ■ ■ , 
evaluate the extent to which the ERIC system is achieving' its objectives. 



The purpose of the Wanger study was to evaluate the quality and utility of these 
products-, to assist USOE in developing policy-related guidelines for the develop- 
ment and dissemination of NCEC . information-analysis products. The purpose df the 

‘ c ' Ok' 

Greenwood-Weiler study was to provided NCEC with exemplary alternative models- for 
the ERIC 'clearinghouse network .that could render ERIC more responsive to the 
needs of_ the education comuahtty. , ' ■ ' 




• 1 • 

There was a notable degree of consensus in the three studies (and in the review. 

of present ERIC clearinghouse practices) on a number of issues and considerations 

regarding possible future directions fpr design of the ERIC system: 

- _ N • ^ ' * I .. ‘ ■ 

>1 ' . » ^ ■ 

• ' It is desirable_tp identify minimum-overlap subsets (partitions) ; 

. .of ERIC materials explicitly keyed "to homogeneous user groups. 

* ’ . * * , 

' ’ . ■ . » \ ' . /X 

• If the acquisition policy is broadened to increase ERIC coverage 

of nbnyesearch materials, the need will also increase to differentiate 
clearly the' kinds of documents to be contained in partitions of t\ie 
' file. " • ■ 

. 

• The creation of' user-related partitions would require the" develop- 

s , ' ■ ♦ 

' ment.of detailed "indexing guidelines so that indexers' could apply ' • 

the different kinds of descriptors consistently. . '• • . 

. f''* - ^ ■ 

• Partitions might be useful , as a mean^ for supporting selective 
dissemination practices, including the dissemination of mlni -RIEs 
targeted to different usei# groups. . 

4 • *• ■«?! ' 

• * • ■ 1 ^ * ■ . , 

3. Conduct of .Questjonnalrd Survey 

The conduct of the questionnaire survey and the analysis of data gathered by 
the survey constituted the major "study activity. The survey instrument was 
designed to determine the inf ormation .needs of educators relative tp a variety '• 
of subject 'areas, information uses, and document types. It was also intended 
to survey awareness and/or' use of ERIC products and services and to gather 
.suggestions -from both users and nonusers about the most useful .types of products 
and services that ERIC might provide. 



The questionnaire was administered to a. proportionate sample of 3145 educators 
divided among 28 categories.. In an effort to get as high a respqnse rate as 
possible, 6919 questipnnaires_ (or 2.2 times the desired sample) '•'were mailed. 
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By cutoff date, 2309 (33%) were returned. After elimination of questionnaires 
that were less than half completed and contained non-us^ble responses, the data 
. on the remaining 2258 questionnaires were keypunched for computer tabulation. 

Cross-tabulations of the data resulted in two :k.lnds of information. The tabu- 
. latlon of background data provided the basis for a user group t 3 rpology and helped 
to characterize the respondent population/ Tabulation of responses on subject 
af'eas, uses, document types. Intensity and frequency of need, sources of. Infor- 
^ mation, and ERIC use contributed to the development of information-need profiles 



for 15 user groups: 



/ 



' •'( 

•• 

> 

I 



Preschool/Kindergarten Teachers 
Elementary Teachers / _ 

Secondary Teachers -■ v / 

Adult Basic Education Teachets 

■ - ■ ■ - ■ . / 

Postsecondary Teachers / 

Reading Specialists , 

Vocational Educators / 

Spec,ial Educators ; 

Superintendents/School Board Members 

Principal? /Assistant .Principals 

. ' ' ■/ 7 • , ' ' ■ 

Counselors/Psychologists / 

Librarians / ' . , 

Consultants/Supe°rvisors/Curriculum Directors 
State Agency Staff 
Researchers 



r 






The profiles were used toyidentify need clusters that could provide so^>b|is is 
• for . partitioning the ERIC file. . • ^ 

^ . V 

v» * ■ 

C. USER-GROUP PROFILES . 

A con^ariQon of the 15 user-group profiles created by the cross-tab\iiations 
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revealed some similarities that cut across all groups, as well as a number of 
'differences, that set the groups apart: 



a 



• All groups tended to seek information' from as many sources as 
possible and tended to identify books consistently as a principal 
'' source of information for nearly all subjects and uses . 



\ 



i 



• There was a tendency for most respondents to want more than one 

■ 

document type for any subject pr use. However, in this area 

* 

there are some distinctions between groups in the types of docu- 
ments desireSJ . . , 

• Only two groups indicated a desire for data per se. Thes6 groups 
were Superintendents /School Board Members and Researchers. The 
former group was interested in data on Budget and Finance, v/hile 
the latter wanted data on Testing and Evaluation..' 



• In general, the expressions, of needs seemed, to be direct functions 
' of respondent roles. For examp5?e, there was virtual consensus 
(over 90%) amon^ teachers the need for practical curriculum* 
materials, for classroom use'. Researchers' agreed on’the need 
fcr technical reports, for research use. 

► - ' ■ . ' .0 ■ ‘ • 

Of the 15 user-groups,' the only group of whom a majority identified ERIC as a 

■ principal source. of information was Researchers. Their use w^s sprlmarily for. 

* research and consulting . There were respondents in all of the user groups wh o 

__jfiported-TrSliSg“ERIC as a principal source, but the percentages in these other 

groups were much- lower than those of the Researcher group. 

\ 

Tabulations of the extent of ERIC use by. the entire respondent pcspulation showed 
that twenty-two percent had. used ERIC products o‘r services. The most heavily, 
used ERIC products are (in order): Research in Education ( RIE) , various kinds of 

bulletins. Current Index to Journals in Education (CUE) , and bibliographies. 
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. D. IMPLICATIONS OF THE STUDY FOR PARTITIONING THE ERIC FILE 
. 1, . Potential Benefits of Partitioning the ERIC File 

~ ’• ^ 1 ”] ^ 4- ''4 

There could be sever^ important benefits from partitioning the ERIC $ile: 

« '• ' ‘ " • . V ' 

4 ; . ** . ■ 

• • to identify ERIC as a resource that can help meet the information 

needs of all segments of the educational community. 



i<l 



•. to improve retrieval efficiency, in terms of speed and relevancy, 



• • to improve the ERIC acquisitions program and to identify needed 
‘ ' information analysis products. 

‘ . • to qupport the dissemination of selected information, targeted to 

♦ _ ‘ ■ > ' 

a particular, audience or- for, a particular use; 

' V - 

Each of these benefits addresses an. area, of need in the ERIC program that. has. 
been identified, to some extent j, in previous studies. 



2. Alternatives for Partitioning the ERIC File 



/ 



Potential bas^ for partitioning the ERIC file exist in turrently available- 
elesients of .the file, •including: ' . 

'' a ' • * 

H ' ' ... 

• Research in Education ( RIE) and Current Index to Journals in Education 
• - (CUE) , literature classes that represent current practice in ' 

physical partitioning. . • " ’ 

^ - ■ , . 

• Publication date and monthly update tapes, which represent a continuing 

time partition of the .ERIC file. • - 

• ERIC clearinghouse .areas , which already represent a kind of partition- 

ingr-particularly in the sectionaliziiig of RIE . 
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In addition to the currently available elements, there are several facets of 

'descriptors incorporated into the Thesaurus , of ERIC Descriptors ..that could be 

elements for partitioning if they were applied consistently as nonsubject . 

descriptors. The two major types of<^scriptdrs are level *(e.g., elementary) 

and docximent type (e.g. , •curriculum guide) . Another potential element in the" 

descriptor system .that might provide ‘a strong basis f6r partitioning is the • 

- ■ . ■ . , ■ , 
concept of "classes." . These classes would encompass several topics and 

specific descriptors but, in general, would promote some grouping of ^ documents 

that could be related to the general Interests of different user groups, ■ 



The stu% data were examined for com]^lnatlons of these kinds of elements to . 

' ' . * 

identify potential bases for partitioning, including those elements that might 
need to be'inc.prporated into a fubure document descriptor system." 



3. Potential Bases for Partitioning the ERIC File ‘ ^ 

In interpreting the 15 user profiles, it was concluH^'that— tUe primary needs 
pattern^ for eiach group relate directly to primary roles and that there' is no 
slngla formula for applying elements (i.e., subject, document type) with equal 
weight to establish criteria for identifying partitions. 



Two major clusters of needs were reveal^ed to be of common inte' ast to' all , 
teachers and to several other user groujis. ' These two clusters are (1) Practi- 
cal Guidance Materials in Clas'sroom Subjects and (2) .Practical Guidance 
Materials iii Instructional Methods and Process. For example, the Curriculum 
Supervisors and Principals appear vej^y similar to the teacher-group profiles 
(including specialists, such as Reading Specialists and Vocational Educators). 
But differetreres appear for Supervisors in their- expresjsed preference for a 

wider variety of document types than practical guidance materials and, for 

I * flf 

Principals , I in their need both for greater variety and for administratively 

• . ' ® . ' » ■ * 

related materials. • ' . . ' ' . 
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The degr'ee to. which a given set of , documents can serve groups' that are in- 
volved, in differing degrees, with the classroom situation is not known from 
these data, but must be tested empirichlly in the future. 

Seven kinds of general partitions could be identified from the data. These 
candidate partitions appear, a priori, to have the potential for achieving some 
of the benefits identified earlier. These seven partitions are: 

^ ' r * N * 

• Elementary Classroom Subjects ^ 

• ■ ’ ■ . • t ’ . . ■ • • 

I I *" 

• Secondary Classroom Subjects: . • ■ ^ * 

Communications Skills (e.g^, English, Reading, Languages) =. • 

... : ^ ■■ . ; ■ : ■ ■ 

• Secondary Classroom Subjects: 

Social Studles/Soclal Sciences 

* . % I 

■ V 

• Secondary Classroom Subjects: * 

Math and Science 9 . . . . 

• Secondary Classroom Subjects: * o' 

Vocational and Technical 

“ * f . ft . ■ . • 

a ' • * 

■* 

• Instructional Methods/Process 

• Educational Administration .CBudget & Finance) • 



These candidate partitions, and others that are discussed in the report, were 
made on- the basis of the following' additional considerations: 

• " • that the homogeneity of the profiles disguised some important 

variables including level, classroom subject, and learning group; 



I 
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• that the need 'dusters that did hot overlap vrLth the two major* clusters 

‘ were primary qandldates for additional partitions for significant 

user groups; ' 

• that more or fewer partitions could be Identified,, particularly by 
matching classes of subjects with document types. However, these 
alternatives, were posed as' ones which— -particularly If thought of In 
terms of products-r-c Slid serve more user groups with the Inclusion of 
all ^ocumerit types'. More direct targeting to user gr.oups could be 

accomplished with sections organized bj^ document type. 

■ . .* . '? • » ■ . 

The major prerequisites to the establlslmient of such .partitions, are: 

• thatj appropriate nonsubject descriptors be, developed that meet the 

specifications for ^partitioning; . 

• . that the acquisitions and Information-analysls-prpduct program provide 
the Input for the partitions; 

• • that the subject classifications used In the partitions can be applied 
, meaningfully and reliably to Individual documents. 

..’'■'x • ' ’ 

This approach to partitioning can perhaps successfully accommodate' the 
complexities Iri the patterns of needs among educators and provide a flexible ' 
basis for creating and maintaining partitions. ' . 
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E. RECOMMENDATIONS V 
1. Alternative Actions . 

The present study points tp... ' 

■ • Full partitioning of th^'-ERIC file\ « 

, • Selective' partitioning of the ERIC file for pilot operations. 

• Initiation of a pilot SDI program; 

» ■ # 

Alternative 1; Operations with a Fully Partitioned ERIC File .. This alterna- 
tive \lould involve division of the entire ERIC file into sections, largely 
on the basis of subject matter. Usets would be able to purchase Indivfxlual 
sections, as well as complete versions of RIE , CUE , and ERIC microfiche and 
tapes 

" • _ , ■ 

The full-partitioningi^^proach has serious disadvantages: 

• There is presently inadequate information on the relation of 

individual index terms to possible partitions. 

' ' * » • » " 

• There does not yet exist an adequate basis for defining all the 

desirable partitions of the ERIC file. , ' 

• ERI^^ credibility ‘c'ould be damaged if the targeting reflected 

in the partitions proved noticeably .inaccurate. ^ 

Alternative 2: Pilot Operations with a Selectively Fartitiohed ERIC File . 

T^e second alternative would require establishment of 5 to 10 sections of 

the EMC file, as part of a pilot program qimed at testing the concepts "and 

■ » ' 

mecha'nics of partitioning. . ^ 

. ‘ ' ' V,, • 

This : alternative has several positive points: ■ . ’ . 

' It would pr<^ide immediate visibility Fo, a new kind of, EMC targeting.. 
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• It .would provide fairly immediate feedback^on the usefulness ^ 
and adequacy of the partitions. 

. ... ' X. 

• . It would permit USOE to develop partitioning expedience relatively 
safely, working in selected areas where .partitiona. can be defined 

with greater assurance. \^' . . 

» 

The selective partitioning approach also has some disadvantages: 

,• There is insufficient data on which to define the document-tag-to- 

partition relation. 

I ■ ■ € 

/ ■ ' ■ ■ ■ 'n ■ . . • 

I • The amount of overlap in interests among various eduoator user groups 
/ - precludes confident selection of even a few partitions^at this time; ‘ 



■ i 

■ i 



Alte’rnative 3; initiate Pilot SDI Operations. ThV third alternative is to 
• / > \ ,, . ' 
mount an experimental program or selective dissemination of information, r for 

' • . * ) ' 
a limited time, to several hundred educators representative of the educational 

community. Their interest patterns would be translated into individual 

information-requirements profiles , and each month they would receive announce- 

ments on new literature entering the ERIC system. The matching mechanics 
• ■ ‘ * * ’ • ■ 

would be handled by computer, using the monthly ERIC tapes. The program would 
be identified hs experlmentaj, and participants would agree to provide feedback 
information that would Kelp ¥SOE assess the adequacy of specific partit'idns 
and the general effectiveness of parNtitioning. _ ^ ■ 

: " . ■ ■ . ' \' ■ ■ ’ - 
This approach offers many advantages over the two other alternatives. . ^ 

j . ' ' • • 

4 „ •, It would providers low-risk means by whichERIC could move toward 

partition-based operations. 

" . ■ ' ' ■ [ 

• It would provide a means to 'determine' and test the relation of ‘ 

individual descriptors to possible partitipns, before those 

partitions are placed in operation. - 
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^ • It would demand much more information on the bases for partitioning 

than is "presently available. ‘ ^ ' 

• • It would allow .USOE to ignore tlie back file; the pilot SDI program 

could begin fairly soon after the clearinghouses begin to. use 
agreed-upon""new noncontent descriptors recommended by this study. 

• It reflects the same kind of concern with improved , targeting, that ' 

the other approaches: do and would therefore have desirable yj.sibility 

‘to the educational community. * 

j Because SDI operations are a well developed art, there is minimal 

technical or financial risk to USOE'.. - ' ^ 

/ ■ . " •; / 

• Because the program would be advertised as a pilot, there would 

not need to be a commitment to continuation. 

Some possible dlsadvanta'ges. to the pilot SDI approach must also be recognized: 

/ . „ 

• As an alternative to partitioning,^ it would delay movement into 

partition-based oper^ations. ^ ^ • 

• It would <^introduce a new technology into ERIC operations and ^ 
woiild require some startup expense -for operations planning for 

’ acquiring and tailoring an. SDI program, for developing .forms to 

capture user profile information, and the like. It might, 'even , 

on a pilot basis, imply to some .educators a commitment for USOE ’ " 

• . * ■ * • . ‘ 

to cont>inue the service. We regard this as a minimal risk situation; 

• Not all user groups can be included at the outset of- the study; full- 
scale individual SDI operations for the'entite educational community 
jxe probab|Ly too expensive^ and too massive for immediate consideratioh 
hyUSOE. 



We do not regard any of these as serious disadvantages. The SDI pilot opera- 
tion would provide valuable information to support ERIC partitioning objec- 
tives and might prove to be sufficiently valuable that it creates considerable 



user-baseji demand for its continuation as a permanent service. Such a 
service, like some current ERIC services, might be provided through the 

■ , ■ . ■ I ■ -: 

interested partii:ipation of the private sector'. 



2 . Recommended Program 

• ' ; y- 

A three-part integrated program is recdmme'nded • that would provide for the •• 
development of the required improvements in the descriptive system and for 
the “testing of candidate partitions. i " 

•s 

a. Develop and Elaborate Nonsub.ject Descriptors for 'ERIC- Documents . "We 
recommend that two pajor kinds ;of nonsubjett descriptors that are currently 
used in the ERIC system be ’defined and applied consistently as separately 
labelled fields. The*se two kinds of descriptors are: . (1) Level (e.g. , 
secondary); and (2) Document Type (e.g., resource lists).. Drawing upon the 

' * I ' . 

existing descriptors and those used as respohse choices in various study 
• ■ . ' ' • ■ * 

questionnaires, we recommend th.6 following kinds of steps: 

* * . * -“i . 

• Secure as exhaustive a list as possible of potential user 

groups ft>r ERIC; » 

, • Generate the nonsubject descriptors that will identify -and help 
to discriminate between ffie contents of interest to different , 
groups*; • . ' - 

• Enunciate and refine an initial set of indexing itis true tions and 

rules for the nonsubject descriptors, which relate to information 
applications; . . / ' 

‘ ' I 

• Pilot-test interindexer consistency for the nonsubject descriptors; 

• Test the refined subjeqt indexing system at^ all ERIC clearinghouses 

• Install and run the nonsubject indexing system. . " 



b. Develop Associations Between Descriptora and Candidate. Partitions .. In 
order for partitioning efforts to develop, it will be necessary to .identify, 
the clusters qr sets of descriptors (and iSentifiers) that are to be associated 

, O , 

with any given partition. That Identification should be done In such a way as 

to take full advantage of the knowledge and skill of the. ERIC PaneJ. .on Educa-' 

0 . . 

tlonal Terminology, the ERIC olearlnghousea,^ and educational Information 
centers. 



The steps Involved in this task are: 

• « . 

• ifefine one or more important candidate partitions, such as Elementary^ 
Classroom Subjects; 

• Select a team of reviewers to assign tepms from the ERIC Thesaurus 
(plus new noncontent descriptors . to* candidate partitions; 

• Assign descriptors^ to each of the candidate partitions being studied; 

• Carry out on-line testing^ of descriptors on which there Is substantial 
disagreement among the^evlewers ; 

• Refine the descriptor-partltircm. relationships on the basis of the 
on-line test, to provide the material necessary for the pilot SDI 
operation. 

c.- Perform Selective Dissemination of Information ERpetiment . The pilot 

SDI operations are intended to, pro'vidd a means by which. USOE can determine 

and test^ with a minimum of risk, the relationship of Individual descriptors 
y ■ ^ . .* ■ < 

to candidate partitions, before those* partitions are placed In operation. 

0 ' • , . ■ 

Thq, following steps are involved: ^ ' 

• Identify selected user participant group candidates. 

> * / ' * • 
w ■ ^ ■ S ' ; , ' 

Identify descriptors relevant to the selected candidate 
4 participaivl^groups. ^ . 

• Do indexing consistency study of non.content descriptors. 
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.■ • Index the appropriate incbmlng materials to the E^RIC file. 

• Design' the SDI experiment. , , 

» • Evaluate and choose SDI software^ and install. ; > 

• Establish software system experimental .operating protocols. 

, • Design publicity, sign-up and agreement procedures. 

• Run SDI exper;j.ment. 

■ ’ 

• Analyze data and write report. 

The three recommended programs can be' carried out in serial fashion, in 
parallel. Opei^ations in serial require mdre staffing and' funding and present 
a. more complicated management- task, but there are advantages to be realized 
in the closer coordination of the taslcs-and the rapid interchange of results. 
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III. PROJECT ACTIVITIES 



The project Involved three main data-gatherlng activities. 'These were a reylew 
of current ERIC practices, a review of some current ERIC<-related studies, and 
the ^nduct of a* questionnaire survey. Wie review of current ERIC practices 
focussed on an examination of clearinghouse efforts- In partitioning and docu- 
ment tagging y and the concerns iiT'^these areas that were expressed by Clearing- 

'i/ '* O '. 

house personnel. Current -ERIC-related situdles were reviewed for findings that 
might have Impact on recommendations for file partitions or that clearly 
supported their ne^d. These two activities, provided the project staff with 
valuable background Information and suggested Important considerations In the 
study of file partitions. ^ . 



The conduct of the questionnaire survey and the analysis of data gathered by 
the survejr comprised the major study activity. It Involved a survey of educa- 



tor l^ormatlon needs In relation to subject area. Information use, and docu- 
ment type. The results of the survey formed the' basis for user-group profiles. 



These profiles. In {turn, foraed the basis fcfr a Study of the feasibility of 
user-related partltlpns. 



/A. REVIEW OF CURRENT ERIC CLEARINGHOUSE PRACTICES 

* . , Vj 

As part..^of, the review of current ERIC practices , telephone Interviews, or site, 
.visits were conducted with personnel from each, of the clearinghouses to deter- 
mine- present efforts to partition or subset the file and to solicit reactions 
to or suggestions for partitioning the ERIC file. Discussion covered current 

4 

practices In Identifying nonsubject' document characteristics. In summary, the 
^findings were as follOTJs: 



Many of the clearinghouses^ have divided their coverage Into a small 
number of broad subject areas. ” These areas may form the bases for 
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products such as bibliographies or newsletters. FolJ example , periodi- 
cally the Clear^ghouse of Rural Education^ and Small Schools produces 
annotatv'd blb^llbgraphles on. each of six main subject areas. 



Many clearinghouses tag documents with a nonsubject or "form" term. 
However, there is a diversity of methods by which they do this. For 
''.example, some Indexers ^eel that the "form" or^ document— type descriptor 



should be Included in the regular descriptor string. ^ Others feel that 
such tags would be less confusing if they were, in a separate field.' " 



V ^ 

Clearinghouses using' document-type descriptors used them only when the o 
Indexer felt they were necessary or appropriate. Thus, in clearing- 
houses processing primarily research documents, the term "research" 
was frequently not used because it was taken for granted. Other clear- . 
Inghouses reported that "research" was the" ...only document— type descrip'- 
tor* used. ; - • ^ ’ >' i 



There is no real agreement among clearinghouses bn the -value of ,docu-, 
ment-type des,criptors . One problem noted was that people frequently 
did not really know what document type .they wanted, did not know what 
term would be us*ed for t hat document type, or did not want to restrict 
themselves to gna.^r -two- document types. On the other hand, many of; 
'those queried felt that documeh t- type de scrip tSrs , consistently applied, 
would be very useful. • ' . ' > 



There was also -a lack of agreement on the value of a time-based division 
of the file. Clearinghouses per forming machine retrieval were generally 
less concerned with this dimensl.on since the. option to retrieve'’ chrono- 
logically was already open to them. 



• Some clearinghouses tag. documents by an additional dimension — educational 



level, Where, applicable. 
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Generally, purrent nonsubject descriptors are not always used and. In 
some cases, they are not used with any degree of regularity. This 
Inconsistency Is caused, In part, by the l^<;k of standard guidelines 
for using these kinds of descriptors. Furthermore, subject and non- 
subject termff must vie with one another for a position In the descriptor 
string. If too ^ny subject-related descriptors are needed, nonsubject- 
related' descriptors may be omitted; 



There was general agreement that some method of subsetting the file, 
(whether* by cjfeatlng special collections within the main collection or 
by dividing the total fl^e) would make retrieval and, consequently, 
dissemination more manageable. 



' B. REVIEW OF CURRENT -ERIC-RELATED STUDIES ' . , 

Thrott recently completed 'studies of the ERIC system were reviewed by the pro- 
ject staff''‘for their possible contributions In considering the need for, and 
benefits of, partitioning. The data' collections In each study were also 

^ . ‘ I . * . ■ - r 

^cunlned for their usefulness In defining the. actual partitions.* The three 






- . stiidlies are : 



> . I . . . 

• Evaluation Study df ERIC Products and Services Bernard M. Fry. 

• Graduate Library School , Indiana University, Bloomington, Indiana, 

• March 1972. . . 

• Evaluatibn Study of NCEC Informatlbn Analysis Products; Fina l 
V Report . Judith- Wanger . System ^Development Corporation, Santa 
, , Monica, ^'California. June 1972. 



*A fourth study was- nearing completion , at the time of this wrlti&g. Conducted 
by Or. William J. Paisley, at •>; the ;.Staniord University Institute for Cqmmuni- » 
cation Rfesdarch, it shouli, b’4 particularly valuable In supplementing the 
user profiles developed here. ' ’ 
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• Alternative- Models for the ERIC ClearlnRhouse Network . P.W. 

. Greenwood 'and D.M. Weller. The RAND Corporation, Santa Monica, ‘ 

California.^ '’January 1972. , 

- - t 

. t ' . ■ 

Each of these studies Is summarized here,, with emphasis on those findings and 
recommendations that bear directly on this study. ' 

‘ '■ f 

1. . Evaluation Study of ERIC Products and Services ‘ , 

The purpose of Dr. Fry’s study was to examine the i^se made of ^IC products 
and services by members of the educational community, and . In this, context , to 
evaluate the extent to which the ERIC system Is achieving Its objectlveh. 

Data obtained from several survey questionnaires to users, of ERIC and sub- 
scribers to CI.TE and RIE. onrslte Interviews') ERIC clearinghouse and EDR5- 
records, and opinions of experts focussed on: (1) the use of ERIC products 

and services ; (2) purpose of use; (3) characterlst'lcs of users and nonTUsers ; 

. C4) extent, of awareness of the ERIC program among .ejiucatbrs ; , (5) reasons for ‘ 
non-use; (6) suggestions for improvements; and (7) the overall impact oi^ ERIC 
In meeting Information needs of. educators and researchers. 

Findings here that appear to be of . some importance to the present study are:* 

Document acquisitions: Many ERIC users express the heed for a wider 

^ range of resource materials than unpublished research .documents • 

■ ■ ■ * ■’ , . ' ® 

Thesaurus of ERIC descriptors : ; , . 

• Only one out of eight respondents Indicates he approaches : RIE and 
CUE through the Thesaurus . ; V ? 



• Suggested changes ojr improyements include: J . 

— gearing terms to practitioners or researchers, not , to both. 




— identifying ..documents by type. 

% 

— descreaslng tbe number of descrlptqrs for categories and increasing 
. " the number for topics. 

Research in Education (RIE) ; * 

Subscriptions to RIE leveled off after reaching a peak in 1968. 
Individual subscriptions to RIE have declined, both in terras of 
absolute numbers and in percentages (from 13 percent to 4 percent^. 

f Reasons given for using RIE are: 

-- . by, administrators : keeping abreast in a field, research 

projects, program Improvement, curriculum developent. 

— by teachers ! research projects,. assignments and term papers, 
reports, keeping abreast In a field. 

■ * , • 

— by researchers: research projects, curriculum development, 

keeping abreast in a field • . 

r- ■ Two-thirds of users consult RIE primarily to locate a docup^cnt 
which contains specific Information. Less than one user in 
five reads or scans each issue solely , for current awareness. 

• Suggested changes or improvements Include: / 

— coding level .'(age, elementary, high school, etc.) 

— coding type (speech, survey, report, etc.) 

— indexing consistency as between general or specific 

Current Index to Journals in Education (CUE) 

Of particular interest is the virtual absence' of individual 
subscriptions. 

• Highest frequency of usage among , individuals was reported by 
librarians and graduate students. 



• Two of every three users of CUE search the index for fepecific 

Information. One out of seveii reads or scans for cUr^nt awareness. 



Inffarmation-Analysis Products ; A substantial-* number of users of the 
ERIC system do not ifBe the infoxn^tiofi^analysis productjs to any great 
extent.. The relative lack of use of products was attributed to vrider- 
spread lack of awareness of the existence of these summary publications 



Activities recommended for advancing ' ERIC's usefulness Include: 

• probing further into the reason for non-use of ERIC products and 
. services, as a means for testing more conQlusively some of the 

'reasons proposed in the study*, e.g., lack of taxgeted Materials, 
research vs. practitioner, orientation, efc. . 

* , 

• "reexamining the centralized vs. decentralized concept of the ERIC 

s ystem , particularly with regard to indexing and abstracting opera- 
tions. ° 

c , 

• examining the document sales and distribution procedures.,, now < 
handled through at least four different outlets and considering 
the possibility of SDI systems both directly to individual users 
and through state and local agencies. 



o « ^ ^ 

« studying the policies and procedure^ underlying the growth of 
the ERIC collection in relation tb..-the most, effective use of 

* V • 

. this knowledge. Including consideration of the option for 
.developing a- range of. document— information delivery systems 
targeted to partlcula;r .user communities.. 
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developing a systematic program for Informing the educational 
community--and when appropriate, on a user-subject basis — 
providing direct, targeted distribution of information-analysis 
products . 



e strengthening dissemination of products and services by undertaking • 

■ • • , ■ 

. a cost-benef itreffeptiveness ^study, Including the study of suqh 
alternatives as-SDI systems, separate sectional (partitioned) publl- 

1 

cations, distribution *of Inde^ journals to specific target populations, 
and .expansion of machine searching services. ' 



The author emphasizes that, these recommendations were made in full recognition 






of the^dlverslty of the educational community's information requirements. 



2. Evaluation Study of NCEC Information Analysis Products; Final Report 

y ■ 

The purpose of the Wanger study was to assist the U.S. Office of Education in 
developing pqllcy-related guidelines for the development and dissemination 6f 
fICEC information-analysis products -b,y evaluating the quality and utility of. 

•s 

these products, - . 



The study was •concerned with - three kinds of Information-analysis products: 

■ ’ ^ ■■ ' . ■ • 

■■ ..-•■•^ ' '-i .. ■■ 

Reviews of 'research and practice And state-of-the-art papers from 
ERIC clearinghouses • , ■ ■ , > 



9 ..Practical Guidance Papers, Including PREP (Putting Research into 
Educational Practice) reports and i^^rts from ERIC clearinghouses 

e Bibliographies, Including those from EMC (Educational Materials 

a 

Ce^Ater) and ERIC clearinghouses 
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As stipulated by. 17S0E,'' the project was to focus only on the products, and not 
means by which ‘they Were conceived and prepared. Within this scope, 
the study had two major goals: 



on 



• To obtain information from, a cross-seotion of educators regarding . 

V 

their '"level of familiarity with NCEC information analysis products 
and their judgments of the quality and utility of those products. 



• To assess the survey methodology in terms of its potential 
applicability to continuing evaluations of NCEC products. 



- It was, reported that NCEC products are on the whole favorably^, received by the 
survey respondent population. Important for the present study is the conclusion 
that the' products' are underused,. This is in part because of lack of awareness 
of the products’ ‘existence and in part because of a belief that the products are 

* 

vnot readily accessible. It was recommended that an Improved alerting or announce- 

■vW ' 

r 'men t system— -perhaps even a selective dissemination of information (SDI) system — 
should be developed. - . . . 



Some of the product-use data reported are also of importance to this study: \ 



In general, readers , indicate that Reviews and Practical Guidance 
Papers are used .primarily -'to obtain overviews of topics" and "to 
update knowledge about already known subjects." One of the least 



frequent uses of these products was "to obtain new knowledge." 

; • 



‘ However, use varies to some extent with the educator's role and 
setting. ‘ For exanqyle, in contrast with the overall pattern of • 

usej Elementary Teachers report high usage of Reviews both to 

' ■■■ 

update" knowledge and to obtain new knowledge. , " 
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The author stated that there were no patterns of differences among the ratings 
of the product types; however, the types of expectations ‘reflected in evaluators' 
comments and the jdifferences in patterns of use among user groups srggested that 
information-analysis products need to be redefined, for example, in terms of 
families of Reviews for. different uses and different audiences. 

.In conjunction with this observation on the diversity of expectations among the 
'^valuators, the aiithori urged that each product contain a clear statement of its 
purpose, limitations, and Intended audiences.' And,' to the extent possible, 'this- 
information shoulch'lie^Jncorporated into the descriptor system. 

In addition, some of the Interest data by user group — comparable to the cate- 
gories of user groups introduced in the present study — were reviewed to pupple- 

<? 

ment the subject Interest data obtained in the present study.. Subject areas 
.used in the Product Evaluation Study were basically those of the current 
clearinghoi:^. structure and are useful, . therefore, in discussing ■clearinghouse 
areas as candidate partitions. 

3. • Alternative Models for the ERIC Clearinghouse Network ' 

The purpbse of this study was to provide NCEC with exemplary alternative models 
for the ERIC clearinghouse network that could render ERIC more responsive to the 
needs of the education community. The RAND study team surveyed the scope and 

sources of education literature, analyzed the utility to the user of existing and 

0 

planned non-ERIC Informiatlon resources, and studied the operations of the 
currbnt ERIC system — through interviews With ERIC system personnel. . 

In creating a functional framework within which, several alternative models 
could be developed, the RAND s^taff characterized current ERIC practices and " ' ' 
reported oh the views that had bee^n expressed during the course of their study. 
Suggestions that were made or Inferred by the staff included the -following 
(taken verbatim from the report); 
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Indexing . Users complain . about the profusion of descriptors 
that may have only tenuous connections with a particular' docu- 
ment. The result is that- ERIC searches generally retrieve an 
extremely large mimher of documents, but they -are difficult ro 
screen for reliance, even using, the abstracts. Classifica^flon 
of documents (by type or intended audience might greatly reduce 
this problem .X (Underscore added.) ' x . 



• Access . Access to th®' literature for . most users mighl^be greatly 
increased if some smMl subset of the entire ERIC collection were 

■ / V 

available for loan at a reasonable number of Itacations. 



■V. 



• Reviews . Unfortunately, most usere^re unaware of this review 



function and are usually dnable to distinguish such papers from 
"*• ^ all of the others in the ERIC data base, [There is] a very low 

rate of practitioner-oriented output at many of the clearinghouses. 
Some directors would be the first to admit they should be doing 
more, but claim they cannot find out who their potential audience 
is or what it really wants. . ' 

Prj^or to introducing mbdejLs involving substantial changes in the clearinghouse 

i-Vi» '■ . . 

network, a variety of changes in the cufrent system were, suggested ghat might 
improve its responsiveness. These chWges included: 



• ' More aggressive pursuit of practice literature. 

I ■ ^ 

\ * . . 

K ' ^ 

• Greater differentiation of the data base. ...precision of infor- 
. matlon retrieval [could be improved] by differentiating the ERIC 

database along lines that reflect* the interests,- abilities, and 
backgrounds of various ERIC .user groups,^ Differentiations by type 
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of docvment (e.g., report of research, evaluhtlon of research, 
description of program, exposition of ideas), by intended audience 
(researcher, teacher; administrator, information specialist), by 
historical or current value, or by educational discipline (English, 
Mathematics, Art) could dll mlnlmlzd the present difficulty of 
■ll'terature searches. 



Some of the alternatives proposed were organizational and others represented 
substantive content changes. Some of these alternatives represent groupings . 
of educational subject areas that are useful in thinking about partitions along 
the subject dimension. . 

One. such model Is the Consolidated Model, which reduces the number of clearing- 
houses to eight, including: 



CONSOLIDATElf CHs 

Communication Skills 
Arts & Sciences 
Career Education 
Special Education 



/ 



PRESENT CHs f 

English, Reading, Modern Languages 

Science & Math, Social Science ^ 

Adult Ed, 'Vocational Ed \ 

Urban Disadvantaged, Early Childhood; 
Rural Education, Exceptional 
Children 



Education & Information Technologies Library & Information Sciences, 



Higher Education . > 

Management, Evaluation, & Guldande 

New Concepts . 



. ^Media & Technology 

Higher Ed, Junior Colleges, Teacher Ed 

Management, Test &' Evaluation, 
Counseling & Guidance -> 



,4. A Summary of .Some Key Issues 

In the review of present ERIC clearinghouse practices and the’ tfhree studies 
summarized above can be found- a notable degree of consensus on a number of 
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Issu&s and considerations regarding poselble future directions for design of 

s . 

th.6 ERIC system; U - „ > 



• Desirability of Identifying minimum-overlap subsets (partitions) 
of ERIC materials explicitly keyed' to homogeneous user groups ; 

. Present practices In some clearinghouses use Inroad subject areas 
to perform the "Initial focussliig" function In searching, -l.e., 
aggregating most of the relevant material for a range of similar 
Information needs intoVone "partition," and eliminating most of . 
the, material completely non-relevant to that range of needs. . 
Similarly, use of tags for document form, educational level, and - ’■ 
time-division of, materials provide the bases for implementing 

such subsetting or partitioning desiderata. Fry’s study noted. 

" ) . jts ' 

the Importance of the distinction between applied or practitioner- 
' oriented materials and researQh-orlented materials, this .distinction 
providing another possible basis . for file partitioning. His recom- 
mendatlon to decrease, the number of categories and Increase the 
number of topical headings moves toward revision of the thesauru^ 
frolh ah open or pure coordinate approach to an‘ approach favoring 
a hierarchically structured controlled vocabulary. If the generic 
levels of description . are chosen carefully, they can ease the • 

, task-of sorting materials into user-group oriented partitions. ' . 
Fly’s finding that current .awareness products are most frequently 
' used to satisfy what amount to demand search needs ^an be used to 
‘’support that argument for file partitioning to Improve search accuracy 
, and efficiency, as can his recommendations for targeted distributions 
of various Information analysis products. 



Similarly, Hanger's finding that .reviews are used by elementary 
teachers for continuing education -and maintenance needs suggests 
the possibility of at'tempting t'o develop a file partition addressed 
spec'lflcally to these needs,, and her more general recommendation 
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that products be required to be described In terms of their Intended 
uses , goals , limitations and audiences suggests that such descriptors 
could be Incorporated Into indexing practices and then used as bases, 
for file partitioning. 



The RAND study also suggests characterizing the intended audience fpr^ 
'each piece of ERIC material, and notes that the practitioner/researcher 
diatlnfction is an important one that is not cons:^dered In current ERIC 



information description practices. They mention a number of .tagging 

' • ' ■ , " ...... ^ 

categories that could prove very useful for file partitioning: 
intended audience (such as research, administration, teacher, infor- 
mation specialist), document type, discipline area (mathematics, 
English), and historical and current value. 



Effects of broadened acquisition policy ; . If a concerted effort is made 
to "increase the ERIC coverage of nonresearch materials, the need vjiill 
also increase to differentiate clearly the kinds pf documents' to be 
contained in partitions of the file. The present under-use of infor- 
mation analysis protects discussed in detail in the Wanger study, ' 
suggests the additional possibility that much relevant material is 

I - • 

currently being "lost" in the file. ' 



Recommendations for Indexing practices ; The creation of user-related 
partitions would require the odevelopment 'pf detailed indexing guide- 
lines so that indexers could apply the different kinds^;^f descriptors 
'consistently. (Candidate elements for the unit recptd of each document 
were, mentioned previously.) \/' 



. File partitioning and dissemination practices ; If, as suggested by’ 
Wanger, SDI programs are a desir^le way to alert users to ERIC — to 
fcoth its rdgular acquisitions and its information-analysis products — 

• - c , 

then partitions might be useful as a means ior supporting such SDI/ 
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activities, including the dissemintition of mini-RIEs targeted to 
; different user groups, or mirii-tlEs (Practices in Education)^ 

- t^argeted to different user groups;- c . 

C. . CONDUCT OF QUESTIONNAIRE SURVEY" . - ‘ ' 

1. Survey Design 

... ■ ■ . • ' • ' ' ' a . 

» ■ ; 

The questionnaire survey was designed to determine the information needs of 
educators relative to subject areas. Information use, and document type. It 
was also. Intended to survey awareness and/or use of ERIC products and servlqes. 
alKl to^i^^her suggestions from both users anci nonusers about the most useful 
types of products and services that ERIC might provide. 

a. The Questionnaire ' 

The questions were designed to: ■* . . . 

. * • * . . ' 

' • Collect demographic data°on role, function, experience, and other 

data that describe the respondents. (Questions 1-10.) 

• Collect data about" respondents ’ interests . in terms of subject areas. 

• (Questions 11 and 12.) • 

\ . * * * • * • 

1 . -0 

•. Collect data abont type of information needed, the sources of that 
information, and intensity and frequency of’ heed related to subjects 
-for which there is high interest. (Question 13.) . ’ . 

• Collect data about respondents' uses' of Information. (Questions 
,14 and 15i> 

<a , * 

% > »'• 

■ * ■ . ' ■ - r • ^ ■ 

A . , ■ 

• Collect data about kinds of information needed, the Intensity and 

frequency of need for. that. information, and the« sources or document 
types. (Question 16.) • - 
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• Determine relation of information tises to subject areas for uses and 
Subjects of importance tq, respondents; and determine adequacy of in- 
formation received- by respondents to date. (Questions 17 and- 18.') 



Determine use 6r nonuse of ' ERIC products and servlcesj. 

■ . ^ - 'I 

. 19 and 20.) ^ . 




• Solicit suggestions from both users and nonusers for products and 

services that would help in thel^r wprk.' 

• • ■ - . ' ■■ ~ 

. • ■ d ' ' ■ 

The questionnaire is somewhat complicated in design. To aid in completion of 
the questionpaire, therefore, a sample of the most intricate section was , 
included in each mailing along with a cover letter exp.lainlng the study qnd a^'-p" 
return envelope. Copies of all of the items in the mailing and a copy 'of the 
cover letter for the follow-up mailing are included as Appendix B. 

<v 

Individuals in the Office of Education 'and on the Project Advisory Board reviewed 
the questionnaire and proylded input for revision. ° 

♦ 

Sample Selection 

The sample contained- 28 types of educators. These fell- into two broad cate- 
gories — those. who were associated with school districts (2l categories), and 
those who were hot (7 categories) . The participants in the sample were pre- 
domlnantiy school teachers, a reflection of the fact that* the largest 
proportion of educators consists of' tqachers. The 28: categories were based o'n 
a review of relevant literature and discussions with the project monitor and 
project"cohsultants and were selected to reflect the. .spectrum of ‘educators. 

A table of the categories an^ the number in each category are given in Appendix C 
To allow an adequate number of each type ^ of respondent^vto-be' included Uri'- the 
sample, and to provide f dr appropriate repreaehtation of respondent types', a 




sample size of at least 3145 was required. The minimum number considered ade-^ 
quate per participant type is 30. Below. that, .the confidence bands deteriorate 
rapidly , 

^■Ithough the, total sample was intended to be a proportional one, the proportion- 

ali^ waij adjusted to accommodate some categories with very small represdntafeion. 

With ^miniTaum number of 30 in each category, strict proportional! tycswould have 

required some categories to have excessively large samples (e.g. about 19,000 

■ 

elementary classroom teachers). Since this did not seem warranted, it was 

decided to maintain the minimum sample size of 3145, which we expected to 

I ' . ' 

achieve by mailing the questionnaire to 6919 educators of 2.2 times the desired 



School districts made up the primary sampling units of the study. The districts 
were stratified by size and 20 districts were selected. This was done to ensure 
a nationwide distribution of both large and small districts. There was ho 
attenq>t to obtain a representative sample of school districts, since the concern 

^ ■ C' 

was with information needs as a function of participant characteristics. 

The districts chosen for the sample were selected randomly, within the ' 
constraints of size and region, from the Education Directory , 1970-71; Public 
School Systems . (A more detailed discussion of district selection is contained 
in Appendix C.)' -- ‘ , _ 









Participant Selection 

To -promote responses, the questionnaires were sent to individual educators by 
name.. Since the questionnaires were mailed very near, the end of ^e schoo). year, 
they were sent to home addresses wherever possible. The procedure for contacting 
individuals within the school districts ^as as follbws/ 
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Cc itact was ' first «made with the state education agencies to explain the study 
and the purpose 6f the questionnaire and to determine whether state policy 
•. permitted surveys-of the state’s-educators . The initial phone contact was 
.. followed by a~Tetter to the chief state school officer with copies to appro- 
■ prl a t'^- personnel in the state agency. The letter served to confirm the per- 
.mission pf the state office Co conduct the survey and included a copy of the 
questionnaire aldng with amove detailed explanation of the study. The state ' 
. agency personnel contacted are ■listed in Appendix C. 

, With approval of the state agency, initial phone contact was i,.ade with, the 
chief ' administrative officer in §ach of the^achool- districts to be sampled. 

The phone contact was used to explain the study and the survey, to alert the 
'_j^,8uperintendents tP the more detailed explanatory letter which would follow, and 
, to. assess the willingness to cooperate. The school districts officers were 
• asked‘ to„8TJpply the project team with lists of district personnel, including 
positions and addresses. In three cases ,. district policy did .not allow the 
♦release qf personnel Hsts. Whexe this Happened, the district was requested 

♦ ■ 0 ' : i ■ ■ ' • ' ■ , 

* to perform the samp^ng and supply only the names of those selected as 

- . .... . - - - \ 

respondents. In two instances, districts selected originally were unwilling 
to participate in the survey in any capacity.^ Replacements of the same size 
were found in .the same states.. ‘ / 

Following the phone .'calls , detailed explanatory letters were, sent to the school 
distrlfcts aqcompanied by an' overview, bf the project. ' . 

. ... . , 

With oversampling, an average of 200 respondents were selected in .each of -the 
school districts. The respondents were chosen at random by type of function. 



y 



' ■■■ 



The six categories of respondents unaffili^te^ with school districts V.ere 
conta'cted..in the' following manner 'S* 
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. • II I- 18 . . ' ^ 

, . ' ■ ■ "■ ■ 

Private nurseries and preschoola — Complete listings of such schools 

were not available. Therefore, schools were selected randomly from 

ft ■ . . . « • ' , 

telephone directories' of major cities. Since most such schools are 

<r. ■ , ' ■ " 

fairly small, over 300 schools were selected to ensure the sample 
requirement of 360 participants would be reached. Each school was 
sent three questionnaire packages and a letter requesting ^he head 
pf. the school to distribute them to members Of the staff. 

X. . . ' • . 

Junior College Teachers — Fifteen junior colleges were selected _ at 
: random from published lists of such Institutions. The participants 

were selected randomly from the catalogs of the junior. colleges 
selected. • . ’ 

\ ' Adult Education Teachers Slxty-slx teachers speclaillzlng In adult ' 

' ^ education were selected from seven schools or centers. < These schools 

were selected from listings In districts already contacted for regular 
sampling. . ‘ ' 

Private Vocational and Technical Teachers — The Ame'rlcan Vocational 

- - - , . , ^ ■ ■ I ■ I — - j • 

Association In Washington, D. C. , provided lists from which 484 
' ' ■ . 
participants were chosen from approximately 50,000 active members. 

Institutional/University Researchers — 132 researchers were selected 
, from a list of the members of the American Educational Research 

Association who designated research as their prlmairy Interest. 

State Agency Personnel ^ — The questionnaire was sent to l50 people at 
various state education agencies.' USOE suggested a minimum number of 
categories of participants and selections were made from the Education 
Directory— State Governments 1971-73 . . 

' ■ .. '■ 55 ' . . . ^ 
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2. Questionnaire Mailings and Returns , 

• 'O' , 

Once the participants were selected, each was assigned a number. / Since the 
Identities of the private preschool and nursery teachers were not .known, the 
numbers were assigned to their, schools. These numbers, which were stamped on, 
the questionnaires ,. served only to eliminate respondents from the follow-up 
mailing list. Persons who had not returned the questionnaires after three weeks^ 
were sent a second package with a follow-up letter .replacing the original cover 

« . ' • o ■ . • j * ' 

letter. (The follow-up letter Is Included In Appendix B.) 

Questionnaires were mailed t6 6919 Individuals and schools;' before the cutoff 
date, 2309 (33%) were returned. . “ , 



A preliminary check was made of the questionnaires returned. Those that were 

less than half completed' and those containing only 'nonsensical or, confusing 

1 ■ ' ’ ■ • . • : ■ 

sponses were set aside. Data on the remaining 2238 questionnaires were 



/ 

res 

// 

keypunched ' for conq)uter' tabulation. ’ 

I ■ ' ■ . . ■ . 

3. Data Analysis - 

a. Tabulation of Data . ... 

The mechanldal tabulation of the questionnaire data through question 10 pro- 
vlded the background Itfformatlon descriptive of the respondent population, 
and also served ^ a basis for the formation of a typology of user groups. 

The background Information items tabulated were: . 

• Primary educational role 

• Leve^^(work setting) ’ 

• Teaching area (subject) 

• Special education responsibilities . ; 
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• Years of experience In current educational roles 

• Level of education attained. 

Also tabulated were responses relating to: ’ 

, Q ■ # • n • 

• Subject areas (Interest) \ 

■■ ■ - . . \ 

• Applications or uses of Information . ' - . 

These data had a direct Impact oh the development of user-group profiles. The 
analysis of profile elements was done In two steps. First, all the potential 
subject Interests and uses were .tabulated for each user group. The results of 
these tabulations were used to determine the major subject Interests and uses 
for each of the user groups. . 

» , / ' ' ' 

The determination of major subjects and uses were. made In the following manner. 

• . 5 - ' 

First, tables were created displaying the number of times each cholce"was 
ranked one, two, three, four,* oV five. A weighted total was then taken for 
each choice.* The weighted totals helped to avoid the distortion that might 
have : ^resulted from taking a simple total of the number of times an Item was 
ranked one of the top five. Once the major subjects and uses ^for each group 
were determined,- further tabulations were based on them. 

# 

in addition to the items that contributed directly-tO' the user-^roup profiles, 
the following items were analyzed fnr ancillary profile elements (th,it is, 
elements that either rounded out the profiles or, helped in their Interpretation): 

• Document types . 

• Intensity of information 'need 

• Frequency of need 



*For the subject choices, this was done by giving each rank-one choice a weight 
of five, each rank-two chpice a weight of* four, and so on. The same was done 
for use choices, with a rank-one choice, receiving a' weight of three, and so on. 
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• Current sourpes of Information 

• Extent of ERIC use'. 



These Items were arrayed against the major subject Interests and uses for each 
user group. The resulting profiles are, presented In Chapter IV. 



A summary table was created showing the most frequently occurring . subject/use/ 
document-type combinations for the entire r.espopdent population. Another table 
was created tp show the proportions by which the respective user groups Indicated 



their preferences for“ the subject/use/documeiit-type combinations. -The dls- „ 
tortlons that resulted from connecting the three 'elements artificially inade 



these tables: Inconclusive and they were- abandoned. 



b.' Description- of Respondent Population 



It has been sho\<m <that the tabulation^ of background Information from the 



questionnaire returns served two purposes. First, It pro-Vlded a basis for a 



user group typology for which profiles could be created. Second, It gave an 
Indication of the types of educators- that responded to the questionnaire. 

This, In turn, .showed to what extent returns .correlated with the ‘sample groups 

.o' • . ^ 

of educators. - ' - 



Creation of a user group typology . Through the tabulation ov; questionnaire 



jl. 



responses tp Items on respondent background, a set of uher groups was. Identified, 
that corresponded to the user groups In the survey sample.. The groups that- • 
resulted from combinations of role, level, subject, and special education 



*The combinations were artificial in that it was possible only to “represent all 
occurrences of the thyee elements together, whether or not the respondent had 
related them. Since the respondent had 'the opportfinlty to make multiple 
responses, the three elments could easily appear together foi one respondent 
without being related to oiie another. 
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responsibilities were then considered in terns of group size. • Since the 
statistically standard number required for stable percent^glng is 30, altexua- 
tlve ways were consldlfred of dealing with those groups having fewer than. 30 
respondents. The alternatives were to: (1) combine th& smaller group with 

a larger one similar in role or^functlon, (2) retain the small group as a 
separate entity (if the number is at least 10) and keep the size in ml^nd when 
considering the data; or (3) eliminate ^the group from further consideration. 
T^us> guidance counselors were combined with psychologists, school board 
members Were combined with superintendents, and student teachers' and graduate 
students were excluded. 

Educators working In special education were not sampled as a group but were 
considered part of the random sapling of .other groups. However, in response 
, to a special edU^catlon item, a sufficiently large number of questionnaire 
respondents indicated their work to be in one or more 'fields of special 
education so that they constitute a separate user group in the study. 



Background informatdon . ^he proportions of returns from the educator groups, 
when compared/with'!the proportions of the _ survey sample, gave an indication of 
the degree^ to which the two proper tions^,jaatch. Table III-l shows this com- 
parison.^ , 

‘ ' ' • ■ ■■ 

The most significant dlfferehce shown in this table is In the Preschool/ 
Kindergarten -group. This difference is exaggerated by the fact that the 22.8% 

represents the combination of 11.4% public apd, 11.4% private teachers. Because 

( 

of difficulties in. locating private preschool/kindergarten teachers, this group 
was not sampled individually, but rather by school. This method of contact 
made.^ follow-up extremely difficult. Furthermore, since there was no district 

to work through, as with public schools, the Influence of higher-level approval 
was missing. All these factors no doubt contributed to a low response from 
private presphool personnel. 
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TABLE III- 1 ° ' 

TYPOLOGY OF USER GROUPS SHOWING RELATION 
OF SAMPLES TO RESPONDENT RETURNS 



-• '‘'■'>-.EDUCATOR TYPE 


% OF 
SAMPLE 


% OF 
RETURNS 


Preschool/Kindergarten 


' 22 . 8 


' 6.6 >> 


Elementary Classroom Teachers 


22.9 


24.8 • 


Secondary Teacl^ers ^ 


22.5 


24.6 


Adult Basic Education Teaches 


1.0 


-vl.4 


Post^econdary Teachers 


1.8 


3.8 


^ Reading Specialists 


•, 1.0 


2.8^ 


.Vocational Educators 


13^2 


7.0 


Special Educators ' ^ 


__a 


3.7 . 


Principals 


2.0 


. 4.3 


Superintendents/School Board < 


2.0 


“ 1.6 


Counselors /Psychologists 


‘1.1 


2.3 


Librarians . 


' . 1 

1.0 ■* 


■ 


Consul tants/Supervlsors/Currlcuium Directors 


> 2.0 


3.1 


State Agency Staff 


4.8 


5.3 


Unlvfivslty /Institutional Researchers 


2.0 


2.1 • 


Others . 


V. 


4.6 



^his group was ihciuded In the random sample of other groups* 
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In all of the cases', the proportions are useful primarily in indicating the 

.1 . ■'5 ■ , ■ 

types of groups that responded heavilyj pr lightly. However, since thie groups 

• ' ’ t 

*were considered ‘separately from 'each other for the majority of the study, 

■ • ■ 

their relative proportions are not important to the study. conclusions. 



The Digest of Educational Statistics, 1970’ provides background information op “• 
e^ementairy and secondary teachers , which may be compared with' that of survey 
respondents from these two groups. The Digest . gives the average years of 
experience for elementary and secondary teachersi^ as 13.4 and 10.0 respectively. 
The average years of experience for the two groups of respondents were 12.2 

• •> j > I 

and 10.6 respectively. Table llX-2 shows the highest levels of education 
attained by elementary and secondary teai^Kers (as given in the Digest ) as 
compared with, the highest levels of education attained by questionnaire 



respondents in these two groups. 

\ " 1 .. ■' 






3LE III-2 



HIGHEST LEVELS OF EDUCATION ATTAINED 
BY ELEMENTARY ^AND. SECONDARY TEACHERS 





Elementary . 


\. S.ec^dary 


Dlges t 
• 


Respondents 

■■■%. . 


Digest 
. % 


Respondents 
. % 


V 

Levels 


No 4; yr. degree 


12.9 


1-0 


0.6 


- 


a 

B.A. or B.S. 


71.4 


72;0 


67.7 


, 57.0 


M.A. or M^.S. 


15.7 

1 


.,26.0 


31.5 


41.0 


Doctorate 


• 1 




0.3 \ 


■ 1.0 


Other ” 


— 


1.0 




1.0 



